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What is claimed is: 

1. A data processing apparatus comprising: 

an analyzing section which receives as its input 
structure description data with a structure of entire 
media contents that are continuous visual and audio 
information or of part of the media contents, said 
structure being expressed by a set of time information 
of each media segment obtained by dividing the media 
contents, and which acquires the time information of the 
media segment described in the structure description 
data input thereto; and 

a converting section that converts the structure 
description data into representation description data 
expressive of representation order, representation 
timing and synchronization information of the media 
segment, using the time information of the analyzed media 
segment, to output. 

2. The apparatus according to claim 1, wherein the 
structure description data has a set of alternative data 
to the media segment, and said converting section 
converts the structure description data into the 
representation description data expressive of 
representation order, representation timing and 
synchronization information of at least one of the media 
segment and the alternative data. 

3. The apparatus according to claim 1, wherein the 
representation description data is a SMIL document. 
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4. The apparatus according to claim 2, further 
comprising : 

a media selecting section that selects either the 
media segment or the alternative data to represent in 
5 representing the media segment expressed in the 
structure description data, 

wherein based on selection by said media selecting 
section, said converting section converts the structure 
description data into the representation description 
10 data expressive of representation order, representation 
timing and synchronization information of either the 
media segment or the alternative data. 

5. A data processing apparatus comprising: 

a selecting section which receives as its inputs 
15 structure description data with a structure of media 
contents that are continuous visual and audio 
information in which image information and audio 
information are synchronized, said structure being 
expressed by a set of each media segment obtained by 
20 dividing the media contents, with time information of 
the media segment, and with a score based on a context 
content of the media segment, and a selection condition 
for selecting a predetermined media segment from the 
structure description data, and which selects only the 
25 media segment with the score meeting the selection 
condition from the structure description data input 
thereto; and 
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a converting section that converts the media 
segment selected in said selecting section into 
representation description data expressive of 
representation order, representation timing and 
synchronization information of the media segment 
selected, to output. 

6. The apparatus according to claim 5, wherein the 
structure description data has a set of alternative data 
to the media segment, and said converting section 
converts the structure description data into the 
representation description data expressive of 
representation order, representation timing and 
synchronization information of at least one of the media 
segment and the alternative data. 

7. The apparatus according to claim 5, wherein the 
score is indicative of an importance degree of a 
corresponding media segment based on the context content 
of the media content. 

8. The apparatus according to claim 5, wherein the 
media segment is assigned a viewpoint represented by a 
keyword, and the score is indicative of an importance 
degree based on the viewpoint. 

9. The apparatus according to claim 6, wherein said 
selecting section selects either the media segment or 
the alternative data to represent in representing the 
media segment expressed in the structure description 
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10. A data processing apparatus comprising: 

a selecting section which receives as its inputs 
structure description data with a structure of media 
contents that are continuous visual and audio 
5 information including at least one of image information 
and audio information, said structure being expressed 
by a set of each media segment obtained by dividing the 
media contents, with time information of the media 
segment, and with a score based on a context content of 

10 the media segment, and a selection condition for 
selecting a predetermined media segment from the 
structure description data, and which selects the media 
segment with the score meeting the selection condition 
from the structure description data input thereto; and 

15 a converting section that converts the media 

segment selected in said selecting section into 
representation description data expressive of 
representation order, representation timing and 
synchronization information of the media segment 

20 selected to output. 

11. A data processing apparatus comprising: 

a selecting section which receives as its inputs 
structure description data with a structure of media 
contents that are continuous visual and audio 
25 information, said structure being expressed by a set of 
each media segment obtained by dividing the media 
contents, with time information of the media segment. 



and with a score based on a context content of the media 
segment, and a selection condition for selecting a 
predetermined media segment from the structure 
description data, and which selects the media segment 
with the score meeting the selection condition from the 
structure description data input thereto; and 

a converting section that converts the media 
segment selected in said selecting section into 
representation description data expressive of 
representation order, representation timing and 
synchronization information of the media segment 
selected to output; and 

a representing section which receives as its inputs 
the representation description data and the media 
contents, and which represents the media contents 
corresponding to contents of the representation 
description data. 

12. A server client system comprising: 

a server having the selecting section according to 
claim 11 and the converting section according to claim 
11 ; 

a client having the representing section according 
to claim 11; and 

a network that connects said server and said client, 
wherein said server and said client communicate the 
representation description data therebetween. 

13. A server client system comprising: 



a server having the selecting section according to 
claim 11; 

a client having the converting section according 
to claim 11 and the representing section according to 
claim 11; and 

a network that connects said server and said client, 
wherein said server and said client communicate 
therebetween summary structure data with therein the 
media segment selected in said selecting section only 
left . 

14. A data processing method, comprising: 
receiving structure description data with a 

structure of entire media contents that are continuous 
visual and audio information or of part of the media 
contents, said structure being expressed by a set of time 
information of each media segment obtained by dividing 
the media contents; 

acquiring the time information of the media segment 
described in the input structure description data; and 

converting the structure description data into 
representation description data expressive of 
representation order, representation timing and 
synchronization information of the media segment, using 
the time information of the analyzed media segment, to 
output . 

15. A data processing method, comprising: 
receiving structure description data with a 
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structure of media contents that are continuous visual 
and audio information in which image information and 
audio information are sy nchroniz ed said structure being 
expressed by a set of each media segment obtained by 
5 dividing the media contents, with time information of 
the media segment, and with a score based on a context 
content of the media segment, and a selection condition 
for selecting a predetermined media segment from the 
structure description data; 

10 selecting only the media segment with the score 

meeting the selection condition from the input structure 
description data; and 

converting the selected media segment into 
representation description data expressive of 

15 representation order, representation timing and 
synchronization information of the selected media 
segment to output. 

16. A data processing method, comprising: 

receiving structure description data with a 

20 structure of media contents that are continuous visual 
and audio information including at least one of image 
information and audio information, said structure being 
expressed by a set of each media segment obtained by 
dividing the media contents, with time information of 

25 the media segment, and with a score based on a context 
content of the media segment, and a selection condition 
for selecting a predetermined media segment from the 
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input structure description data; 

selecting the media segment with the score meeting 
the selection condition from the input structure 
description data; and 
5 converting the selected media segment into 

representation description data expressive of 
representation order, representation timing and 
synchronization information of the selected media 
segment to output. 
10 17. A program for a computer to execute the procedures 
of : 

receiving structure description data with a 
structure of entire media contents that are continuous 
visual and audio information or of part of the media 

15 contents, said structure being expressed by a set of time 
information of each media segment obtained by dividing 
the media contents; 

acquiring the time information of the media segment 
described in the structure description data input 

20 thereto; and 

converting the structure description data into 
representation description data expressive of 
representation order, representation timing and 
synchronization information of the media segment, using 

25 the time information of the analyzed media segment, to 
output . 

18. A computer program for a computer to execute the 
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procedures of: 

receiving structure description data with a 
structure of media contents that are continuous visual 
and audio information in which image information and 
5 audio information are synchronized , said structure being 
expressed by a set of each media segment obtained by 
dividing the media contents, with time information of 
the media segment, and with a score based on context 
content of the media segment, and a selection condition 

10 for selecting a predetermined media segment from the 
structure description data; 

selecting only the media segment with the score 
meeting the selection condition from the structure 
description data input thereto; and 

15 converting the selected media segment into 

representation description data expressive of 
representation order, representation timing and 
synchronization information of the selected media 
segment to output. 

20 19. A program for a computer to execute the procedures 
of: 

receiving structure description data with a 
structure of media contents that are continuous visual 
and audio information including at least one of image 
25 information and audio information, said structure being 
expressed by a set of each media segment obtained by 
dividing the media contents, with time information of 



105 



the media segment, and with a score based on a context 
content of the media segment, and a selection condition 
for selecting a predetermined media segment from the 
structure description data; 
5 selecting only the media segment with the score 

meeting the selection condition from the structure 
description data input thereto; and 

converting the selected media segment into 
representation description data expressive of 
10 representation order, representation timing and 
synchronization information of the selected media 
segment to output. 

20 . A computer readable storage medium with the program 
according to claim 17 stored therein. 



